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The invention relates to a system that is capable of executing macro 
commands, and in particular to a system that comprises a user controlM)le device and a user 
mterfece arranged to receive user selectable commands and to send control signals to the 
device for effecting execution of the commands, at least two of said user selectable 
commands having an opposite effect. 

The invention further relates to a remote control unit and to a controllable 
device for use in flie above s>^tem. 
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PCX patent appUcation WO 98/59284 describes a method and apparatus for 
creating macro commands for a home network. The network receives conmiands for example 
from inputs in an HTML page. Initially, each input, when activated, causes execution of a 
user command. A macro command involves execution of a series of such user commands 
upon activation of a smgle, newly defined mput for that macro command. 

A home network with home devices as defined in WO 98/59284 (WO 
98/59284 excludes general purpose conq)ut€as fix>m the definition of home devices) 
interconnects electronic devices that are typically found in the home. Such a network is 
operated by consumers, which are usually not skilled technicians. In practice, it has been 
found that such unskilled users dont write their own new macros. 

WO 98/59284 describes various ways of assisting the user to generate macro's. 
For example, the use of a preset macro is described for presetting the parameters of the 
system to some preference. A preset macro is generated by reading the values of parameters 
of the system when the system is in the preferred state and copying these values into 
commands in the macro for setting these parameters. In another example, a macro is 
generated when the user instructs the system to record a macro. The system records the 
commands given by the user after this mstruction into the marao. In another example macros 
are prepared externally, for example by the manufecturer of a device in flie system. 

Amongst others, it is an object of the invention to provide for a system that 
allows unskilled users to profit &om macro definition. 
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The invention provides for a system comprising 
a user controllable device; 

a user interface arranged to receive user selectable commands and to send 
control signals to the device for effecting execution of the commands, at least two of said 
5 user selectable commands having an opposite effect; 

a memory unit arranged to record a first sequence of received commands; 
a matching unit for determining whether a second sequence of commands 
received subsequent to said first sequence matches or counter-matches said first sequence; 

the systmi being arranged to add a fiirth^ command and a further opposite 
1 0 command to the usct interface in response to detection that said second sequence matches or 
coimter-matches said first sequence, the fiirfher command and the further opposite command 
becomiag user selectable so that in response to user selection of the further command, the 
user interface sends control signals for executing a s^ies of commands corresponding to 
commands of the first sequence, and in response to user selection of the further opposite 
15 command, the user interface sends control signals for executing a series of commands 
corresponding in an opposite way to commands of the first sequence. 

Examples of opposite conmiands are volume up/down, brightness 
hi^er/lower, channel up/down etc. The system thus takes the initiative to select the content 
of a macro. It obtains the contents of the macro by copying sequences of commands that the 
20 user has used to control the system. Matching sequences are inserted in system generated 
macros with mutual opposite effect Sequences of commands are said to match when they 
have the same lasting effect on the system after the completion of each sequence. That is, 
sequences that differ only in commands that have no lasting effect, such as later corrected 
erroneous commands or commands for tCTaporary lookup of information,, are stiU said to 
25 match. Such inconsequoatial commands need not benncorporated in the resulting series of 

commands of the macro. Sequences of commands are said to counter-match when they have 
1- * an opposite lasting effect on the system after the completionof each sequence. 

Various situations may trigger the system to generate the macros. For 
example, if the user successively operates the channel-up button a specific number of times, 
30 and after a while successively opCTates the channel-down button the same number of times, 
the system may react by generating a macro both for shifting the selected channel upward 
and downward that specific number of times. Altanatively, the system waits for at least a 
second occurrence of this chaxmel up/down loop. A user who is repeatedly zapping between 
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two non-adjacent channels is thus provided with macro commands for skipping the 

intennediate channels, and immediately selecting the desired channel. 

In another situation which may trigger the generation of opposite macros, the 
user perfoims substantiaUy the same sequence of commands at least two times. The system 
then generates a macro corresponding to this sequence, and an opposite macro which 
accomplishes the opposite effect of the sequence of commands, for example by copying the 
sequence of commands and i^lacing each command, if possible, by its opposite command. 

In an embodiment of the system according to the invention the matching unit 
is enable of recognizing in the first sequence an it^ation of abasic command, the system 
bemg arranged to determine an opposite basic command which has the opposite effect of said 
basic command, and include an iteration of said opposite basic command in said fiirther 
opposite command. It occurs very often that ttie user operates the same button iteratively, for 
example to substantiaUy increase a certain parameter such as sound volume or picture 
brightness, or zap through a number of chamiels; Typically, these types of commands have a • 
counter-command for accomplishing the opposite effect, i.e. decreasing the sound volmne or 
picture brightness, or zapping in reverse direction. The invention is particularly useful for 
generating opposite macro commands for such iterative parameter adjustments. 

In an embodiment of the system according to the invention user selection of 
the further command mvolves at least selection of said basic command and user selection of 
the further opposite command involves at least selection of said opposite basic command. 
Particularly if the sequence consists only of an iteration of a certain basic command eg 
chamxel up. the invoking of the resultant macro advantageously involves that basic command 
Itself. It saves additional macro buttons on the (remote) control unit, and it is easier for the 
user to remember how to invoke the macro. Mvoking of the opposite macro command then 

mvolves the basic-wosite command. This can be achieved in various ways; 

In an embodiment the control unit comprises a single macro button, which for 
example has to be-pressed before or after the button corresponding to the basicxommand. for 
confirming execution of the macro rather than the basic command itself. Por example 
pressmg the 'chamiel up' button followed by pressing the macro button causes the syJtem to 
execute an earher defined macro involving an iteration of the 'chamiel up' command 
Pressing the ' chamiel down' button foUowed by pressing the macro button causes the system 
to execute the opposite macro involving an iteration of the 'channel down' command. 

In an alternative embodiment the macros can be selected by prolonged 
operation of the buttons corresponding to the related basic commands. For example, a short 
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press of the ^channel up' button causes the next channel preset to be selected, whereas a 
prolonged press of the button causes zapping througlh the channels by as many steps as 
included in the macro. 

In yet another embodiment the macros can be selected by simply operating the 
buttons corresponding to the related basic commands, i.e. the macro command temporarily 
r^laces the normal command. The normal command may be selected by prolonged or 
iterated operation of the same button. The system may warn the user by generating feedback, 
e.g. on tihie television screen, that the normal command now reqmres a different operation. 
The normal command may, for exan:iple, be restored after a predetermined period of time, 
after a deliberate selection of the basic command (e.g. by prolonged operation), or, in case of 
channel selection, by explicitly entering the desired channel preset number. 

It is not necessary that such a macro includes only one iterated command. It 
may very well be that the user, while repeatedly switching between two non-adjacent 
channels, also systematically adjusts the sound volume as well, e.g. by pressing the volmne 
up/down buttons three times respectively. Dependent on what coramand occurs first in the 
sequence, the resultant macro may be assigned to the button related to that particular 
command, i.e. in the example given, the macro consisting of an it^ation of channel up/down 
commands and an iteration of volume up/down commands will be assigned to the channel 
up/down buttons respectively. 

The invention can be implemented in an independent remote control unit, 
comprising all the means for generating the macros, and transmitting the macro commands to 
a controlled device. Alternatively, a conventional remote control xmit is used, but its 
conm[iands are interpreted according to tixe invention, i.e. sequences of conmiands are 
detected, opposite commands are determined and macros are generated within the controlled 
apparatus. It is also possible thatthe inventive means are divided over the remote control unit- 
and the controlled device, for example, the macros may be generated in the device, but 
additional sigaals may be transmitted to. the controlled device in order to give feedback yiaL.^ 
the display or speakers of the controlled device. 

These and other advantageous aspects of the system, method and apparatus 
according to the invention will be described in more detail using the following figures. 
Figure 1 shows a system of home apparatuses 
Figure 2 shows a flow-chart for defining a macro instruction 
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Figure 3 shows a remote control unit according to the invention 



Figure 1 shows a system of home apparatuses 1 1, 12, 13, 14 interconnected by 
a bus 10. Although a linear bus structure is shown, any bus structure, such as a tree structure 
in the caseofaP1394 bus, may be used. Byway of example, two of the ^aratuses 11, 12 
are shown to have an input 110, 120 for remote control signals for remote control units .112. , 
122. A ttiird apparatus 14 is shown in more detaiL A control unit 142 containing for example 
amicroprocessor, a memory 140, a user interfece 144 and a display unit 146 are shown. 

In operation, a user may use the system for example to perform operations like 
playing or recording video or audio information in the home. For example, one ^aratus 1 1 
may be a video source and/or.recording device, such as a video recorder, a DVD player, a 
magnetic disc unit or the Kke, and another apparatus 14 may be a televisions set. In fhis'case, 
the user instructs (he video source 1 1 to retrieve the video information and send it to the • 
television set 14 via bus 10. The user instructs television set 14 to receive the video 
information from the bus 10, to decode it and to show it on display unit 146. In another 
example, the user instructs the television set 14 to output video infc«mation via the bus 10 to .. 
a recording device 12 and the user instructs recording device to r^ive the video information 
and to record it. 

Yet another one of the ^paratuses 12 may be a set-top box 12 for receiving ).. 
video signals from a cable system, or an Litemet interfece unit 13 etc. These may also serve 
as image sources, video sources, audio sources or data sources of information that may be 
displayed, output or recorded in the system, or as receivers for such information. 

All such operations are controlled in more or less detail by the user. Some 

operations are started by a single user command, but often the user will have to eater a series- 

of two or more commands to cause the system to execute the operation, indicating for 

example a data source and a data destination., as well as what has to be done with the data. & 

one mode, the user uses a central user interface 144 for entering all such commands. In 
another mode, the user uses one or more remote control units 1 12, 122 to enter the 
commands. Entry of commands may be an interactive process, in which a menu or a dialog 
box (e.g. an image showing various buttons to select commands) is displayed,, for example on 
display unit 146, in order to show the user which commands can be entered and how. 

The system enables flie user to define new commands, so-caUed "macro" 
commands which are composed of two or more commands that can be given to the system. 
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Once a new macro command has been defined, the system enables the user to select this new 
command, for example by adding the new conomand to a menu, adding a "button" for the 
command to a dialog box or associating the command with a button, or combination of 
buttons on a remote control unit (generally, this will be called adding the command to the 
system). When the user selects the conomand^ the system executes the commands of which it 
is composed in response. 

For exanq)le, the macro command may instmct the system to record 
information that is currently displayed on a specified display device on a specified recording 
device. 

In an embodiment selection of the macro command occurs when the user 
enters the initial command of the commands of which the macro command is composed, 
followed within a predetermined time by entering a predetermined generic "execute macro" 
command. This supports the user in that, if he or she starts entering the initial command of 
the commands of which the macro is composed and then remembers that the macro has been 
defined, he or she can select the macro by subsequently entering the generic macro 
command. If a part of the macro has been executed manually, the system should only play the 
remaining part of the macro (retrieving fi-om memory the already past sequence). 

In order to help the user define macro conunands, the system takes the 
initiative to suggest new macro commands. The system monitors commands given by the 
user and when the system detects that the user has given two or more series of commands 
match with each other, the system constructs a sequence of commands for the matching part 
of the series of commands and asks the user whether a macro conomand should be added for 
executing this sequence of commands. 

In the case that the macro command includes commands which have a 
"counter-command having an opposite eflEect, the system is arranged to construct two macros, 
one having the same effect as the detected sequence of commands, and one having the 
- opposite effect This may also be triggered by the event that the juser has entered two 
sequences of conomands, the second having an effect which is opposite to the effect brought 
about by the first sequence. This may be achieved by copying the first macro and replacing 
all commands, when possible, by their opposite commands. 

Figure 2 shows a flow-chart of steps for adding macro commands in this way. 
In the system of figure 1, these steps are executed for example by control unit 142. In a first 
step 21, the control unit 142 monitors commands given by the user and detects whether a new 
command has been entered that is the end of a potential macro sequence. The control unit 
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142 identifies a series of commands as a potential macro sequence for example if the 
successive commands in the series are given less than a predetermined time (for SKsaaplG 10 
seconds) after one another. The end command of such apotential macro sequaice is not 
foUowed by another command within a predetermined time (for example the same 

5 predeteiinined time as used to identify the potential macro sequence, ofa longer time, for 
example 30 seconds). 

In a second step 22, control tinit 142 stores the potential macro sequence in 
memory 140. If necessary space for storing is created in memory, for example by discarding 
one or more least recently used potential macro sequences. In a third step 23, control unit 142 
10 searches through memory 140 for a previously stored potential macro sequence that matches 
or counter-matches the newly stored potential macro sequence with a matching part that does 
not correspond to the sequence of conmnands of an existing macro command. In a fourth step 
24, control unit 142 branches back to the first step if it finds no such matching potential 
macro sequence in memory 140. 

If control unit 142 does find such a potential macro sequence, it executes a 
fifth step 25, suggesting to the user to define a new macro command for the potential macro 
sequence and a further macro command with an opposite effect, for example by displaying a 
message on display unit 146 that a potential new macro sequence has been found, togeflier 
with a listing of the effects of the commands of the potential new macro sequence. 
Alternatively, confirmation of the user is not awaited and the macros are generated.anyway, 
preferably after showmg a notification to the user. Subsequently, the control unit resumes 
fiom the first step 21. 

If the user enters a command to approve addition of tiie new macro command, 
or if tiie approval is not required, control unit 142 adds the command to flie system, for 

25 exanpeso that upon entering a command fixmi user interface 144 the commands from the 
potential new macro sequence, or the matching part of the sequence are generated. However 
without-deviating from the invention other interfaces 1 12, 122.may.be. used to trigger 
execution of the macro commands. The control unit 142 may select automatically which 
mterface may be used, for example implementing the macro command on one or all of tiie 

30 interfeces from which commands where received in tiie potential new macro sequence. 
Alternatively, tiie control unit 142 may ask flie user to indicate to which mterfece tiie new 
macro command should be attached. 

Preferably the system has a command that allows the user to enable and 
disable suggestion of tiie new macro command in tiie fifth step (for example by selecting a 
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"disable/enable macro suggestion" button in a dialog box). This allows the user to restrict 
macro suggestions to times when they are desired* 

The control unit 142 may use various types of criteria in the third stqp 23 to 
detemiine whether potential macro sequences match each other. In one embodiment, the 
control unit simply detects a match if two sequences consist of identical commands in the 
same order. In another embodiment a match is detected if in addition to the identical 
coimnands the sequences contain additional cormnands that do not affect ttie end result of the 
sequences, and/or if the coimnands occur in different order in the two sequences, as long as 
this does not effect the end result A similar approach can be used for detecting a counter- 
match between two conmiand sequences. 

In a further embodiment of the n^itching in the third step, control unit 142 
generalizes the parameters of the coimnands in the sequences. That is, if commands wiflx the 
same function in respective ones of the sequences differ only in parameters (e.g. "output 
video to the bus" commands that differ only in the source apparatus of the video), control unit 
142 treats them as potentially matching commands, with substitution of parameters, when 
two potential macro sequences are compared. The substitution relates two parameter values 
to each other, one from each of the matching sequences. When these parameter values are 
substituted for each other according to this relation in all corresponding commands of the 
matching sequences, these sequoice are said to match. 

In the generated macro command, the parameter value may be included as a 
parameter of the macro command, to be entered by the user when he or she selects the macro 
command. As an alternative, the cdntrol unit 142 stores a state description of the system at 
the start of and/or during execution of each potential new macro sequence in memory 140, . 
together with the macro sequence (the state description contains information about active 
data transport stfeams;"channels to which liie q>paratuses are tuned etc.); In this alternative . 
the control unit determines whether the substitution also relates parameters in the state of the 
system stored for the-respective potential new macro sequences. If so, the cpnftpl umt.L42 _ . 
includes in the newly generated macro a command for reading the relevant parameter from 
the state of the system. 

Thus, for example, suppose the two matching potential macro sequences are 
both sequences to record information on a disk unit. In this case, the control unit 142 will 
suggest a macro for storing information on the disk unit But suppose one potential macro 
sequence commands that iirformation from a web page received at an Internet interfrice is 
stored, and the other sequence commands that information from a television channel received 
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at a tuner is stored Suppose jEiirther that control unit 142 finds that a parameter of a state of 
the system indicates that before the start of the two sequences the source of information 
displayed on display unit 146 is respectively the Intemet interface and the tuner. Then control 
unit 146 will add a command to the macro to read the parameter of the state of the system 
during execution of the macro to determine the source of the information displayed on the 
display xmit 146, and commands in the macro will use the resulting value of the parameter to 
indicate the source of the information that is stored on the disk unit. 

In an embodiment of the first step 21, the control unit 142 restricts the 
potential macro sequences to sequences of coherent commands, wherein each command is 
said to be "connected" to another command in the sequence in the sense that the command 
affects or uses data that is afifected or used by the other command in the sequence, and 
wherein all commands are connected to one another directly, or indirectly via other 
commands. 

In an embodiment, control.tmit 142 includes only commands received via the 
control int^ace 144 in the potential macro sequences generated in the first step. In another 
embodiment control unit 142 monitors the bus 10 to detect whether commands have been 
received at other interfaces, such as receivers 120, 1 10 for signals fi-om remote control vmits 
122, 112, or such as control buttons of apparatuses 11, 12, 13. In this embodiment control 
unit 142 also incorporates the commands thus detected in the potential macro sequence, 
stores them in memory 140 and uses them in the third step 23 during matching. 

Figure 3 shows a remote control imit 301 according to the invention. It 
comprises various control buttons among which four pairs of control buttons for adjusting 
television parameters. Buttons 302 enable the user'to adjust the picture brightness, buttons 
303 enable Hie user to adjust the picture contrast, buttons 304a and 304b are used to zap 
iqiward and downward through TVxhannel presets, and buttons 305 ^able the user to adjust 
the sound volume. Numeric buttons 307 are provided for explicit entering of numeric values, 
such as channel preset numb^. A confirmation button 306 serves various functions, for 
exanq>le it enables the user to select a m^u option, or confirm an operation. Oiil5rttiose 
buttons necessary for explaining the invention are shown, additional buttons for e.g. standby, 
muting, menu, EPG etc. may be provided as well. 

Each pair of buttons 302, 303, 304, and 305 includes two buttons which have 
mutually opposite effect, for example respectively increasing and decreasing a particular 
parameter such as audio volume or selected channel preset number. If any of these buttons is 
repeatedly pressed within a certain period of time, the sequence is compared to earlier 
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received command sequences. Within such a sequence, consecutive pairs of oiq)osite 
commands are ignored, because they do not contribute to the final effect of the sequence. If it 
appears that the received sequence matches an earlier sequence, a macro command is added 
which can be selected by the us& by successively pressing the corresponding button and the 
confirmation button 306. At the same time, an opposite macro command is added which can 
be selected by successively pressing the corresponding opposite button and the confirmation 
button 306. For example, if the user presses the channel-up button 304a four times, and the 
same sequrace is fomd to be received earli^, a macro command included four channel-up 
commands is generated which can be selected by successively pressing the channel-up button 
304a and the confirmation button 306. Also, a macro command included four channel-down 
commands is generated which can be selected by successively pressing the channel-down 
button 304b and the confirmation button 306. 

If the command sequence appears not to be received earlier, but the opposite 
sequence was found to be received earlier, the same macro commands are generated and 
similarly assigned to buttons of the remote control unit 301 . For ejcample, if the user presses 
the channel-up button 304a four times, and a sequence mcluding four channel-down 
commands spears to be received earlier, the same macro conmiands are generated as 
described above, and similarly assigned to the buttons 304a and 304b respectively. 

If no matehing or counter matohing earlier sequence was found, the received 
command sequence itself is stored as a potential macro sequence, for comparison with future 
command sequences. 
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1 • A system comprising 

a user controllable device; • 

a user interfece arranged to receive user selectable comxnands and to send . 
control signals to the device for effecting execution of the commands, at least two of said 

usOT selectable commands having an opposite efifect; 

a memory unit arranged to record a first sequence of received commands; 

a matching unit for determining whether a second sequence of conmiandi 
received subsequent to said first sequence matches or counter-matches said first sequence; 

the system being arranged to add a further command and a further opposite' 
command to flie user interfece in response to detection that said second sequence matches or 
counter-matches said first sequence, the fiufher command and the further opposite command 
becoming user selectable so that in response to user selection of the fiirther command, the 
user interface sends control signals for «cecuting a series of commands corresponding to 
commands of the first sequence, and inresponse to user selection of the fiirther opposite 
command, (he user interfece sends control signals for executing a series of commands 
corresponding in an opposite way to commands of tiie first sequence. 

2. A,system according to Claim 1. wherein the matching unit is capable of 
recognizing in the first sequence an iteration of a basic command, the system being arranged 
to determine an opposite basic command which has the opposite effect of said basic 
command, and include an iteration of said oppbsite~b^c command in said fiother opposite 
command. 

3. A system according to Claim 2. wherein user selection of the fiirlher command 
mvolves at least selection of said basic command and user selection of the fiirther opposite 
command mvolves at least selection of said opposite basic command. 
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4. A system according to Claim 3, wherein the user selection of fihe fiirfher 
command and the furOier opposite command finther involves a predetermined command 
precedmg or following respectively the basic command or the opposite basic command 

5. A system according to Claim 3, wherem the user selection of the further 
command and the further opposite command involves prolonged operation of a control 
element corresponding to respectively the basic command or flie opposite basic command 

6- A system according to Claim 3, wherein the further command and the further 

opposite command temporarily replace the basic command and the opposite basic command. 

7 A remote control unit comprising 

a user interface arranged to receive user selectable commands and to send 
control signals to a user controllable device for effecting execution of the commands, at least 
two of said user selectable conmaands having an opposite effect; 

a memory unit arranged to record a jBbrst sequence of received commands; 

a matching unit for detemuning whether a second sequence of commands 
received subsequent to said first sequence matches or counter-matches said first sequence; 

the remote control unit being arranged to add a further conmxand and a further 
opposite command to the user interface in response to detection that said second sequence 
matches, or counter-matches said first sequence, the further connnand and the further opposite 
command becoming user selectable so that in response to user selection of the further 
command, the user interface sends control signals for executing a series of commands 
corresponding to conoonands of the first sequence, and in response to user selection of the 
further opposite command, the user interface sends control siguals^for ^ecuting a series of 
commands corresponding in an opposite way to conomands of the first sequence, 

8. A usOT controllable device comprising 

a user interface arranged to receive user selectable commands for effecting 
execution of the commands, at least two of said user selectable commands having an opposite 
effect; 

a memory unit arranged to record a first sequence of received commands; 
a matching unit for determining whether a second sequence of commands 
received subsequent to said first sequence matches or counter-matches said first sequence; 
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the user controllable device being arranged to add a further command and a 
further opposite command to ihe user interfece in response to detection that said second 
sequence matches or counter-matches said first sequence, the further command and the 
further opposite command becoming user selectable so that in response to user selection of 
the further command, the user inteifece sends control signals for executing a series of 
commands corresponding to commands of the first sequence, and in response to user 
selection of the fiirther opposite command, the user interfece sends control signals for 
executing a series of commands corresponding in an opposite way to commands of the first 
sequence. 

9. A computer program product enabhng a programmable device vi^hen executing 

said computer program product to function as a system or device as defined in any one of the 
claims 1 to 8, 
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In a home system, sequences of received user commands are stored. A 
matching unit detemiines whether matching sequence of commands are received repeatedly, 
or whether a sequence accomplishes an opposite effect. If so the system adds a new macro 
command to a user interface. The new macro command becomes user selectable so that in 
response to user selection of the further command, the user interface sends control signals for 
executing a series of commands corresponding to commands of the first sequence. The 
system also adds a further macro command to the user interface which enables the user to 
accomplish the opposite effect of the first macro commaud. 
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